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Resume: Nous donnons une preuve simple de l’existence d’une sous-solution C 1 ’ 1 de l’equation 
de Hamilton-Jacobi dans le contexte de la theorie de Mather. Nous donnons certaines consequences 
dynamiques de ce resultat. Nous montrons que la solution peut etre obtenue stricte en dehors 
de 1’ ensemble d’Aubry. 

Abstract: We offer a simple proof of the existence of a C 1,1 solution of the Hamilton-Jacobi 
equation in the context of Mather theory. We derive some dynamical consequences of this result. 
We also prove that the solution can be obtained strict outside of the Aubry set. 
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Let M be a compact manifold without boundary. A function H(x,p ) : T*M —> R is called a 
Tonelli Hamiltonian if it is C 2 and if, for each x £ M, the function p \—> H(x,p ) is convex with 
positive definite Hessian and superlinear on the fibre T*M. Each Tonelli Hamiltonian generates 
a complete C 1 flow We consider the Hamilton-Jacobi equation 

(HJ) H(x,du x ) = c, 

with a special emphasis on sub-solutions. A function u : M —■> R is called a sub-solution of 
(HJ) if it is Lipschtiz and satisfies the inequality H(x,du x ) ^ c at almost every point. Note 
that this definition is equivalent to the notion of viscosity sub-solutions, see [2]. We denote by 
C' 1,1 (M, R) the set of differentiable functions with Lipschitz differential. The goal of the present 
paper is to present a short and selfcontained proof of: 

Theorem A Let H be a Tonelli Hamiltonian. If the Hamilton-Jacobi equation (HJ) has a 
sub-solution, then it has a C 1,1 sub-solution. Moreover, the set of C 1,1 sub-solutions is dense 
for the uniform topology in the set of sub-solutions. 

Fathi and Siconolh recently proved the existence of a C 1 sub-solution in [5], see [8] for the 
non-autonomous case. Our result is optimal in the sense that examples are known where a C 1,1 
sub-solution exists, but no C 2 sub-solution, see Appendix A. There exists a real number a(H), 
called the Mane critical value in the literature, such that the equation (HJ) has sub-solutions 
if and only if c ^ a(H). One can prove the existence of smooth sub-solutions for c > a(H ) by 
standard regularization, see [ 3 ]. As a consequence, our Theorem is relevant for the sub-solutions 
of the critical equation H(x,du x ) = a(H), which are called the critical sub-solutions of (HJ). 
The study of the critical Hamilton-Jacobi equation H(x, du x ) = a(H) is the core of Fathi’s weak 
KAM theory. 

A sub-solution u is called strict on the open set U C M if there exists a smooth non-negative 
function V : M —*• R which is positive on U and such that u is also a sub-solution of the 
equation H(x,du x ) + V(x) = c. By applying the Theorem to the Hamiltonian H + V, we 
obtain: 

Addendum If there exists a sub-solution of (HJ) which is strict on the open set U, then there 
exists a C l)1 sub-solution which is strict on U. 

We now expose some dynamical consequences of the main result, which lead to a very short 
proof of the existence of invariant sets contained in Lipschitz graphs: 

Theorem B There exists a unique non-empty compact set A(H) C T*M with the following 
properties: 

(1) A(H) is invariant for the Hamiltonian flow, and 

A(H) C H~\a{H)). 

(2) For each C 1 critical sub-solution u of (HJ), we have 

A(H) C T u := {(x,du x )\x £ M}. 

(3) There exists a critical C 1,1 sub-solution u of (HJ) which is strict on the complement of 
the projection A(H) of A(H) onto M. 

It is an easy consequence of Theorem B that the set A(H) is a Lipschitz graph above A{H) 
and is not empty. We explain in the course of the proof of Theorem B in section [2] that A(H) 
is the set usually called the Aubry set in the literature (although it was introduced by John 
Mather). 

Let us quote explicitely the following: 

Corollary There exists a critical C 1,1 sub-solution which is strict outside of the projected Aubry 
set. 
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We give some examples in Appendix A, which explain why C 1,1 regularity is optimal. Theorem 
A is proved in Section 1, with the use of some properties of semi-concave functions which are 
recalled in Appendix B. Theorem B is proved in Section 2. 

I wish to thank Cedric Villani, whose questions about the geometry of optimal transportation 
led me to the Proposition [2] which is the key of the proof. 

1. The Lax-Oleinik semi-groups and sub-solutions 

We prove Theorem A. It is necessary to start with more definitions. We define the Lagrangian 
L :TM —> R associated to H by the relation 

L(x,v) = max p(v) — H(x,p). 
p&T*M v 

Then we define, for each t ^ 0, the function At : M x M —* R by 

A t (x,y) := min / c + j(s))ds 

t Jo 

where the minimum is taken on the set of curves 7 E C 2 ([0,t\, M) which satisfy 7(0) = x and 
7 (t) = y. Following Fathi, we define the Lax-Oleinik semi-groups Tt and Tj on C°(M, R) by 

T t u(x ) = min (u(y) + A t (y, x)) and T t u(x ) = max (u(y) - A t (x, y)). 

yeM K ' yeM v 7 

The following useful Lemma is proved in Fathi’s book: 

Lemma 1. Given a Lipschitz function u : M —> R, the following properties are equivalent: 

• u is a sub-solution of (HJ). 

• The inequality u(y) — u{x) ^ A t (x,y ) holds for each t > 0 and each (x,y) E M X M. 

• The function [0, oo[3 t i—> T t u(x) is non-decreasing for each x € M. 

• The function [0, oo[3 t i—> T t u(x) is non-increasing for each x € M. 

An important consequence is that the semi-groups Tt and Tt preserve the set of sub-solutions. 
Another important property of these semigroups is that, for each t > 0 and each continuous 
function u, the function Tt.u is semi-concave and the function Ttu semi-convex, see mm and 
Appendix B for the definitions. Recall that a function is C * 1,1 if and only if it is both semi-concave 
and semi-convex. 

If u is a sub-solution of (HJ), then for each s > 0 and t > 0, the function T s T t u is a sub¬ 
solution. We shall prove that, for each fixed t > 0, this function is C 1,1 when s is small enough. 
Ludovic Rifford has pointed out to the author that this is a kind of Lasry-Lions regularization, 
see [7]. Since Tpu is semi-convex, Theorem A follows from the following result, which may have 
other applications. 

Proposition 2. Let H be a Tonelli Hamiltonian. For each semi-convex function v , the function 
T s v is C 1,1 for each sufficiently small s > 0. 

Proof. In order to prove this proposition, it is enough to prove that the function T s v is semi- 
convex for small s, since we already know that it is semi-concave for all s > 0. This follows from 
two Lemmas: 

Lemma 3. For each bounded subset F C C 2 (M, R) there exists a time so > 0 such that, for 
each s € [0, so], the image T S (F) is a bounded subset of C 2 (M, R) and the following relation 
holds for all functions f € F and all x E M 

(1) T s f(x(s)) = f(x) + [ c +L(x(f),x(t))dt, 

J o 

where x(t) is the curve n o ip t (x,df(x)) (tt : T*M —> M is the projection and is the Hamil¬ 
tonian flow). 
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Proof. Let us consider a C 2 function / and the graph T t C T*M of its differential. This graph 
is a C 1 Lagrangian manifold transversal to the fibers. It is known that, for s ^ 0 small enough, 
the Lagrangian manifold ip s (T /) is the graph of a C 2 function, and that this C 2 function is T s f. 
Then, we have ©• The maximum time so such that these properties hold is uniform for families 
of functions which are bounded in C 2 norm (for then the associated graphs are contained in a 
given compact set, and are uniformly transversal to the verticals). In addition, one can choose 
so in such a way that the set {T s f,s £ [0,so],/ £ F} is bounded in the C 2 topology, (which 
amounts to say that the manifolds 'iJj s (L j) are uniformly transversal to the fibers). q 


Lemma 4. Let v be a semi-convex function. Then there exists a bounded subset F C C 2 (M, M) 
and a time so > 0 such that 

T s v = max T s f 

f&F SJ 

for all s £ [0, sq], hence T s v is a semi-convex function for s ^ 0 small enough. 


Proof. If V is semi-convex, then there exists a bounded subset F C C 2 (M, M) such that 
v = max^ / and such that for each x and each p £ d~v{x) (the set of proximal sub-differentials 
of v at point x, see Appendix B), there exists a function / £ F satisfying (f(x),df(x)) = (v(x),p), 
see Appendix B. Let us fix from now on such a family F of functions, and consider the time so 
associated to this family by the first Lemma. Notice that 

T s v ^ sup T s f 
feF 

for all s, because for each / £ F we have / ^ v hence T s f ^ T s v. In order to prove that the 
equality holds for s £ [0, so], let us fix a point x £ M. There exists a point y such that 

T s v(x ) = v(y) +A s (y,x). 

Now let (x(t),p(t)) : [0, s] —> T*M be a Hamiltonian trajectory which is optimal for A s (y, x). 
We mean that x(0) = y, x(s) = x, and 

A s (y,x) = f c +L(x(t),x(t))dt. 

Jo 

It is known (see BUD) that — p(0) is then a proximal super-differential of the function z i—> 
A s (z,x) at point y. Since the function z i—> u(z) + A s (z, x) is minimal at y, the linear form 
p( 0) is a proximal sub-differential of the function u at point y. Let us consider a function / £ F 
such that ( f(y),df(y)) = (u(y),p( 0)). Then we have (x(t),p(t)) = if t (y,df(y)) and, by the first 
Lemma, 

T s f(x) = T s f(x(s)) = f{y) + [ c + L(x(t),x(t))dt = u(y) + A s (y , x) = T s u(x). 

Jo 

We have proved that, for each point x £ M, there exists a function / £ F such that T s f{x) = 
T s u{x). This ends the proof. □ 

The proof also implies: 

Corollary 5. If u is a C 1,1 sub-solution, then there exists e > 0 such that Ttu and Ttu are C 1 ’ 1 
sub-solutions when t £ [0, e]. In addition, we have, for these values oft, 

= ^(PiyJ = ^-t^Ttu) 
where Vf is the graph of the differential of f. 
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2. The Aubry set 

In this section, we consider only the critical case c = at{H), and prove Theorem B. Let us 
first define the projected Aubry set A(H) C M. This is the set of points x £ M such that 
H(x,du x ) = a(H ) for each C 1 sub-solution u. A similar definition is given in [[ 6 ]. 

Lemma 6. If u\ and u 2 are two critial C 1 sub-solutions, then du\ = du 2 on A(H). 

PROOF. If du\{x) A duz{x), then, by the strict convexity of H, the function (u\ +ii2)/2 is a C 1 
critical sub-solution which is strict at x. This implies that x does not belong to A(H). □ 

As a consequence, we can define in a natural way the set 

A(H) := {(x,du x )\x £ A(H )} 
where u is any C 1 critical sub-solution. 

Lemma 7. There exists a C 1,1 critical sub-solution u which is strict outside of A(H). 

Proof. By the Addendum of Theorem A, it is enough to prove that there exists a critical 
sub-solution which is strict outside of A(H). Since C 1 (M, M) is separable, the set of critical C 1 
sub-solutions of (HJ) endowed with the C l norm is separable. As a consequence, there exists a 
dense sequence u n of C 1 critical sub-solutions. The C 1 function 

00 / \ 

/ N U n (x) 

< x ) -■= 2 _. ~^r 

n= 1 

is a C 1 critical sub-solution of (HJ) which is strict outside of A(H). Indeed, for each point 
x 0 A(H), there exists a C 1 critical sub-solution v such that H{x,dv x ) < a(H). Since the 
sequence u n is dense for the C 1 topology, we conclude that H(x,du n (x)) < a(H) for some n. 
The desired conclusion follows by the convexity of H. q 

This Proposition implies that A(H ) is not empty. Otherwise, there would exist a critical 
sub-solution strict on M, which is a contradiction. 

Proposition 8. The set A(H) is invariant. 

Proof. Let us choose a C 1,1 critical sub-solution u which is strict outside of the projected 
Aubry set. We have A(H) = n H^ 1 (a(H)). Let e be given by corollary [5j We claim that 
ift{A(H)) = A(H) for all t £ [— e, e], where ift is the Hamiltonian flow. This claim clearly implies 
the desired result. Let ( x,du x ) be a point of A(H) and t £ [— e, e] . Let us denote by (y,dv y ) 
the point tpt(x,du x ), where v := T t u. Since v is a critical sub-solution, we have ( y,dv y ) £ A(H) 
provided y £ A(H). In order to prove this inclusion, we denote by w the function w := Ttu , 
which is a C 1,1 critical sub-solution. Since x £ A(H ), we have du x = dw x . This implies that 
ift(x,dw x ) = ipt(x,du x ) = ( y,dv y ). Since iftfl'w) = this implies that dv y = du y , and, by 
energy conservation, that H(y, du y ) = a(H). Since the sub-solution u is strict outside of A(H), 
we conclude that y £ A{H). □ 

Proposition 9. If u is a critical sub-solution (not necessarily C 1 ), then T t u(x) = T t u(x ) = u(x) 
for all t ^ 0 and x £ A(H). Therefore, if u is a critical sub-solution, there exists a C 1,1 sub¬ 
solution which coincides with u on A(H). 

Proof. The second part of the statement clearly follows from the first part: just take T e Ttu, 
which is equal to u on A(H). So we have to prove the first part of the statement. It is enough 
to prove the statement for C 1,1 critical sub-solutions, since these sub-solutions are dense for the 
C° topology. It is also enough to prove it for t ^ e. In order to do so, we observe, in the proof 
above, that 

v(y)=u(x)+ / a(H) + L(j(s),'y(s))ds ^ u(y) 

Jo 
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(the last inequality holds because u is a critcal sub-solution) and 

u(x) ^ w(x) = u(y) - / a(H) + L(j(s),'y(s))ds ^ v(y) - / a(H) + L(j(s), j(s))ds = u(x). 
Jo Jo 

It follows that u(x) = w(x) = T t n(x). As a consequence, all the inequalities involved are equali¬ 
ties, hence u(y) = v(y) = T t u(y). This equality can be proved at any point y £ A{H) by taking 
x = 7 r o ijj_ t (y,duy), where ir : T*M —> M is the projection. Indeed, in this case, we have 
du x ) = ( y , dv y ) = (y, du y ). n 

If (7 (t),p(t)) : R —> T*M is a Hamiltonian trajectory contained in A{H). It follows from 
the remarks above that the curve 7 (t) is calibrated by all critical sub-solutions u in the sense 
that the equality 

u( 7 (t)) - u( 7 (s)) = f a(H) + L( 7 (u), 7 (cr))du 

J S 

holds for all [s, t] C R. This implies that our definition of the Aubry set is the same as the one 
given in Fathi’s book. 


Appendix A. Examples 

A.l. Mechanical Hamiltonian system. Let us consider the case 

H(x,p) = ^\\p\\l + V(x) 

where ||.|| z is a Riemaniann metric on M and V is a smooth function on M. Then it is easy 
to see that a(H) = maxk, and that there exists a smooth sub-solution to (HJ): any constant 
function is such a sub-solution! 

A.2. Non-existence of a C 2 sub-solution. Let us now specialise to M = T, and consider the 
Hamiltonian 

H P (x,p) = ~(p + P) 2 - sin 2 ( 7 rx) 

depending on the real parameter P. For P = 0 this is a Mechanical system as discussed above, 
and the constants are sub-solutions of (HJ). Let X(x ) : T —> R be the function such that 
X(x) = sin( 7 rx) for x £ [0,1]. Let us set 



The reader can check easily that a(PJp) = 0 for P £ [—a, a ]. For each P £] — a, a[, the equation 
(HJ) has smooth sub-solutions. For these values of P, the Aubry set is the fixed point (0, —P). 

However, for P = a, there is one and only one critical sub-solution of (HJ), which turns out 
to be a solution. It is given by the primitive of the function X — a. This function is C 1,1 but 
not C 2 . Note that the Aubry set, then, is not reduced to the hyperbolic fixed point (0, —a) but 
is the whole graph of X — a. 

Appendix B. Semi-concave functions 

We recall some useful facts on semi-concave functions, see for example El El for more material. 
In all this section, M is a compact manifold of dimension d. It is useful to fix once and for all 
a finite atlas T of M composed of charts ip : —► M, where B r is the open ball of radius 
r centered at zero in R d . We assume that the sets tp(Bi),ip £ T cover M. A family F of C 2 
functions is said bounded if there exists a constant C > 0 such that 

|| d 2 (u o ip ) x || ^ C 

for all x £ B\, ip £ T, u £ F. Note that a bounded family is not required to be bounded in C° 
norm, but will automatically be bounded in C 1 norm and thus equi-Lipschitz. The notion of 
bounded family of functions does not depend on the atlas <F 
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A function u : M —» R is called semi-concave if there exists a bounded subset F u of the set 
C* 2 (M, R) such that 


u = inf /. 

f£F u J 

A semi-concave function is Lipschitz. We say that the linear form p £ T X M is a proximal super¬ 
differential of the function u at point x if there exists a C 2 function / such that / — u has a 
minimum at x and df x = p. We denote by d + u{x ) the set of proximal superdifferentials of u at 
x. We say that a linear form p £ T X M is a A'-super-differential of the function u at point x if 
for each chart ip £ $ and each point y £ £>2 satisfying tp(y) = x, the inequality 

u o <p(z) — u o p(y) ^p o d<p y (z — y) + K\\z - y || J 


holds for each z £ £? 2 - A function u on M is called A'-semi-concave if it has a A'-super-differential 
at each point. It is equivalent to require that, for each p £ <h, the function 

uocp(y) - K\\y\\ 2 


is concave on B 2 . As a consequence, if u is A'-semi-concave and if p is a proximal super¬ 
differential of u at x, then p is a A'-super-differential of u at x. 


Proposition 10. A function u is semi-concave if and only if there exists a number AT > 0 such 
that u is K-semi-concave. Then, there exists a bounded subset F C C 2 (M, R) such that 

u = min f 
feF J 

and, for each point x £ M and each super-differential p of u at x, there exists a function f £ F 
such that (f(x),df(x)) = (u(x),p). 

Proof. Let us consider a smooth function g : M. d — > R such that 0 ^ g ^ 1, and such that 
g = 0 outside of £>2 and g = 1 inside B\. Let us associate, to each chart </? £ <L, and each point 
(x,p) £ T X M satisfying x £ the function f x , p , v : M —> R defined by 

fx, p ,<p o ip(z) := g{z){u(x) +podip y (z - y) + K\\z - y || 2 ) + (1 - g(z)) max u 

for z £ B 2 , where y = and f x ,p,ip = max u outside of ^(Bf). The functions f x ,p,p-,T G 

£ <p(B\),p £ d + u(x) form a bounded subset F of C 2 (M, R). It is easy to check that 
/ = minf. n 


A function u is called semi-convex if — u is semi-concave. 

Proposition 11. A function is C 1,1 if and only if it is semi-concave and semi-convex. 

A very elementary proof of this statement is given in the book of Fathi. Another proof is 
given in [2], Corollary 3.3.8. 


References 

1. P. Bernard, The dynamics of pseudographs in convex Hamiltonian systems, preprint. 

2. P. Cannarsa and C. Sinestrari, Semiconcave functions, Hamilton-Jacobi equations and optimal control, 
Progress in nonlinear differential equations and their applications, Birkhauser (2004). 

3. G. Contreras, R. Iturriaga, G. P. Paternain and M. Paternain, Lagrangian graphs, minimizing measures and 
Mane’s critical values. GAFA 8 (1998), no. 5, 788-809. 

4. A. Fathi, Weak KAM Theorem in Lagrangian Dynamics, Book to appear. 

5. A. Fathi and A. Siconolfi, Existence of C 1 critical sub-solutions of the Hamilton-Jacobi equation, Invent. 
Math. 155 (2004), no. 2, 363-388. 

6 . A. Fathi and A. Siconolfi, PDE aspects of Aubry-Mather theory for quasiconvex Hamiltonians Calc, of Var. 
22 (2005), 185-228. 

7. J. M. Lasry and J. L. Lions, A Remark on regularization in Hilbert Spaces, Israel J. Math. 55 (1986), no 3, 
257-266. 

8 . D. Massart, Sub-solutions of time-periodic Hamilton-Jacobi equations, to appear in Erg. Theory and Dyn. 
Syst. 


